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(NJ '~ Abstract 

Strategies for Rotating Canonical Components 

f-H 

Q Robert M. Thomdike 

Western Washington State College 

Rotation of canonical components is contrasted with factor rotation 
and thct concept of coiniDunalitier> in canonical analysis is considered* 

Three possible strategies for rotating canonical components are 
described : single rotation of all components, 8eparat;e rotation of each 
set, and sequential rotation of ^ne set then the other* Constraints, 
conditions and consequences of rotation by each procedure are discussed. 
It is concluded that single rotation is logically inconsistent, and the 
other irtrategies may be appropriate in some situations* 
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Strategies for Rotating 
Canonical Components 

ROBERT M* THORNDIKE 
Western Washington State College 

When listening to discussions between investigators who use canonical anal- 
ysiSf one crcasionally hears speculation about the possibility of rotating the 
canonic: 1 components to ease and clarify interpretation of the results* The 
realization of this possibility can probably be traced to the work of Bartlett 
(1948) » who pointed out the similarities between factor analysis and canonical 
analysis, and of Meredith (1964) » who developed the idea*of canonical component 
structure coefficients* Since rotation is a standard and useful procedure in 
factor aaaXysis and siace there are substantial similarities between factor anal- 
ysis and canonical analysis, it would seem that rotation procedures might fruit- 
fully be applied to the canonical components as an aid to interpretation* (For 
the purposes of this discussion we will assume that the diagonal entries in the 
correlation matrix are all unity, so we are technically dealing with rotation 
of principal components*) 

However, the problen of rotation is more complex in canonical analysis 
Dacause there are two sets of variables* Thie concepts of simple structure and 
psychological meaningf ulness are relatively straightforward in a principal 
components analysis because there is only one set of variables • Tlie criteria 
for the location of factors, both original and rotated, are contained within 
the single set, and the Interpretations refer only to that set» Canonical 
analysis provides two sets of component loadings, each determined by relations 
existing between the sets as well as within the sets» Interpretation of the 
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components ma^ involve both betueen-set and within-set relationships , 

♦ 

A multitude of criteria and procGdures liave been advanced for the rotation 
of factors* but all have as their objective simplicity of structure and Increased 
meaningfulness^ These criteria might be applied to the problem of rotation in 
canonical analysis as veil* Hovever, none of the existing approaches address 
the problem of how to handle the relationships between the two sets of variables* 
Rotation in canonical analysis is logically different from the factor matching 
problem* 

Before attacking canonical rotation, it is first necessary tc consider some 
j£ the conditions wtiich exist at the outset of any rotation problem. In both 
factor analysis and canonical analysis a decision must be mde regarding the 
nutifcer u£ factors or coinponents to retain for rotation. This decision determines 
the proportion of variance of each variable which is to be included in tht analy- 
sis» and hencc» the total variance available* A large array of rules of thumb, 
some statistical in nature, some psychometric, and some logical, exist to aid 
In making this important decision in factor analysis. In contemplating t!ie 
rotation of canonical components, it would seem reasonable to retain only those 
pairs of variates which have statistically significant canonical correlations 
since one of the objectives of canonical analysis is to identify pairs of 
components which are correlated* 

Using this decision rule has nn important consequence* It limits the range 
of correlations among pairs of rotated components* Selecting the number compo*- 
nencs defines the space available for rotation, which of course, is also true in 
principal components analysis* We may view canonical analysis as similar to a 
principal components analysis in the sense that in either case the selection of 
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a particular nuihber o£ components defines the common variance o£ each variable* 
The difference is that in canonical analysis there are two o£ these "communal- 
ities" associated with each variable, one given by the sum of squared loadings 
on the composites within its set (which I will call intraset communalities) » and 
one given by the sum of squares of its loadings on the composites o£ ' *e other 
set (which I christen interset cotnmunalities) * Thus» if there are £ variables 
in one set and ^ variables in the other* there are 2 (g+a) constraints or con- 
stants restricting any rotation** with jg+a o£ them affecting either set com- 
ponents* 

These coinmunality conditions have an additional consequence for rotation* 
llie total redundancy of the first set witu the second and of the second with the 
first must remain constant under rotation because each is the mean of tlie sum of 
its respective interset communalities* Since an alternative definition of re- 
dundancy (Stewart and Love, 1968) is the sum of the means of the sums of the*'^-^ 
intraset loadings multiplied by their respective squared canonical correlations* 
and the intraset communalitles must be constant* then the sums of squared canon- 
ical correlations must be constant* Given this restraint* and since the original 
canonical correlations are successively maximum correlations within the conditions 
of orthogonality, the canonical correlations between pairs of components after 
orthogonal rotation will fall in the range between the highest and lowest sign- 
ificant original correlations* 

With these limits and assurances, we may consider three possible approaches 
to the rotation of canonical components* For purposes of illustration, let us 
assume that there are three significant canonical corrclaaons, and, therefore, 
three pairs of components* Tlie first approach might be to rotate the entire 
set of six components to soiae more satisfactory solution* Second, one might 
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rotate each set of three components independently to new locations* The third 
possibility would be to select one of the sets for rotation to an improved solu- 
tion and then rotate the second set to the location which yields successive max- 
imum correlations with the components of the first set* Let us consider each of 
these strategies in somewhat more detail* 

When the components of both sets are rotated simultaneously to a single 
overall solutiun» the rotation is constrained by both the interest and intraset 
communalities* This complex set of constraints may make the rotation difficult* 
However, the more important question is whether this type logically 
defensible* The two sets of variables presumably have been^ffipt separate for a 
reason* If an investigator is interested in the structure of the combined sets» 
then he probably should have performed a traditional factor analysis in the first 
place* Given that the sets are logically distinct, ignoring this distinction in 
the rotation step would seem to be an error* A combined simple structure for 
the canonical components i^; a logical contradiction* 

Ttie second strategy, that of rotating the components of each set to an 
independent solution, is logically consistent with the separation of sets in 
canonical analysis* Once a satisfactory structure is found ;^ithin the set, the 
new canonical correlations may be computed* However, the new components in one 
set may now have complex relations with the components of the other set* The 
criterion of maximum relationship must be sacrificed for clarity of structure 
within set* One may reasonably ask whether it might not be better to factor 
analyze the two sets independently and, after separate rotations, compute the 
correlations between factor scores* The major difference between these two 
proposals is that in the first case the overlap between the sets i^^ put to 
maximum use in determining the spaces defined by the composites, while in the 
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second it is ignored* Either procedure could be defended; however, the former 
would seem preferable where overlap between the sets is being considered* 

In those situations where the structure of one of the sets is of primary 
interest and the structure of the other set is desired with reference to the 
first, and would seem advii>able to use the third rotation strategy outlined above^ 
Assume, for example, that one has data from several measures of achievement as 
one set of variables and So^e personality measures as the other set* It might 
be desirable to find an interpretable structure for the achievement measures and 
then determine the composites of the personality variables which best predict 
those components which were significantly correlated* Then, the components of 
the achievement set would be rotated, perhaps by varimax or some other algorithm, 
to their new positic^s* Finally, the components of the personality set would be 
rotated to new positions, subject to the constraint that each component have 
the highest possible correlation with one of the already rotated achievement 
components* Xfce necessary equaMons ar-e presented-i^v-t-he^iendout* 

There are two major advantages which would accrue from this procedure* First, 
although the criterion of maximum relationship between pairs of components would 
no longer hold precisely, this criterion would be met within the limitations 
imposed by the positions of the components in the first-rotated set* Second, 
£ivinfe the rotation of the first set, this procedure would provide a unique solu- 
tion for *;he second set* 

Of the three approaches discussed, Lhe third seems most in keeping with the 
spirit of canonical analysis* The first may be rejected outright as logically 
inconsistent with fundamental assumption that two sets of variables are being 
analyzed* Traditional factor analysis of the combined data would be the appro- 
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priate procedure* The second approach disregards the criterion of maximum 
relationship* It may be appropriate in some situations while independent factor 
ing3 may be the method of choice in others* Only the third strategy retains the 
fundamental principles of canonical analysis while at the same time seeking 
descriptive clarity* 
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The basic equation of canonical analysis is 

^^22 £21 hi =12 - X-I) v: =0 
subject to the restriction that 

where v^^ is the vector of canonical weights for the I th canonical variate of 
set 2. The vectors of weights, u; , for the variables in set 1 are found from 

"i- =11 &2 " <^ 



and the matrices of canonical loadings are obtained by 

ill = 111 I ""'^ I22 = ^22 h 

Applying an orthogonal transformation T to S^j obtain rotated component 
loadings " 

A 

=22 ' ^22 i 

and 

« ^ =22 ^22 

provides the weights for the rotated variates in set 2, 

Letting g = I2I SUl2' ^^i ' \ k^i ^ 
we can solve for n* , Then 

= hi ^"'^ 



hi = ^11 1 
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